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A structured, time- referenced, performance 
examination was designed as part of the certification procedure for 
Emergency Medical Technicians-Ambulance^ in an attempt to increase 
objectivity and standardization^ This examination is based on a model 
developed by the University of Southern California, School of 
Medicine, Department of Emergency Medicine in Los Angeles. Tasks 
include the treatment of chest wounds, epilepsy, fractures, head 
injuries, and cardio-pulmonary resuscitation. The examination 
procedures were pilot tested and the resulting data were analyzed 
using a statistical computer package. From the analyses, the 
desirability of the quantitative performance evaluation procedure was 
determined, and improvements in the rating form, to enhance 
predictive value, were made. A methodology for continu^Jd evaluation 
and review of practical performance evaluation procedure is suggested 
by the researchers. It is anticipated that this project will make a 
significant. contribution towards the establishment of a National 
Standard Practical' Examination that is objective, valid and 
consistent. Rating forms, scoring templates, and analyses of item 
performance by those passing and those failing the tests are included 
in this report. (Author/CTH) 
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FORWARD 

In an attempt to standardize results of the Basic EMT-A Practical Examination, the 
National Registry of Emergency Medical Technicians has produced a ^^Videotape^* and 
accompanying ^^User's Guide^^ to assist examiners in the administration of the required 
Practical Performance Examination. This examination is based on a model developed by 
thle University of Southern California, School of Medicine, Department of Emergency 
Medicine in Los Angeles. 

This report will present the Registry's recognition of the problems, and the need to 
establish a protocol that would ensure the administration of a uniform practical examination. 

Page two of this report describes the pilot testing of the examination procedure. 
Resulting data were analyzed using a statistical computer package. From the analyses, 
the desirability of the quantitative performance evaluation procedure was determined, and 
improvements in the rating form, to enhance predictive value, were made. A methodology 
for continued evaluation and review of practical performance evaluation procedure is 
suggested by the researchers. 

It is anticipated^ that this project will make a significant contribution towards the 
establishment of a National Standard Practical Examination that is objective, valid and 
consistent- 

Rocco V. Morando 
Project Director 
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INTRODUCTION 

The National Registry of Eir.ergency Medical Technicians has, as a part of its 
certification procedure for Emergency Medical Technicians - Ambulance, required 
that applicants successfully complete both a written and a practical examinationo 
Conducted on a natioaal basis according to guidelines established by the Registry, 
the practical examination became somewhat variable in its administration, as local 
discretion is used in the setup of the examination. Beginning in 1972, the staff 
of the Department of Medicine - University of Southern California Medical Center 
was involved in developing standardized practical examination and an objective 
scoring procedureo 

Dr. Kenneth Kimball, Chairman of the Registry's Examination Committee reviewed 
U. S. C. 's examination. Recognizing the desirability of a more objective evaluation 
and scoring procedure, the Registry approached the Department of Health, Education 
and Welfare for funding to develop such a procedure. In June of 1975, H..Eo W. 
awarded an unsolicited contract to develop a new practical performance examination 
for Emergency Medical Technicians - Ambulance. In mid 1975, representatives from 
the Registry met with Dr. Richard Scott, Director of the Department of Special 
Projects for the U. S. C. School of Medicine to discuss the possibility of developing 
an outline of this excimination for videotape presentation. The Registry contracted 
with the U. So C. Department of Medicine in September, 1975 for the development of 
such a production outline^ After the development of a videotape presentation and 
preliminary written material, the Registry conducted this study of the improved 
examination technique so as to develop final printed material, instructions and 
scoring guides. 



An objective, consistent approach to structuring a practical examination was 
developed, permitting the use, if desired, of non-physician examiners. Guidelines 
for final scoring by a physician, based upon the field studies, were realized ^n 
simplified forms that greatly speed the evaluation of candidates while still 
providing a uniform standard. 

Principal researchers were Dr. David Eubanks, Dean of Emergency and Critical 
Care Technologies, Miami-Dade Community CollegB, and Lester Ascher, Senior 
Operations Ftesearch Analyst, City of Chicago Department of Personnel. . Dro George 
Hyatt, Professor of Orthopedics, GeorgetOTO University Medical School provided 
one of the field testing sites and staff used in this study, Ms. Susan Thrash, 
Examination Research Specialist, City of Chicago Department of Personnel, provided 
assistance in the experimental design of the study and in analysis of the statistical 
results associated with this studyo 
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^* The Energency Medical Technician - Ambulance Practical Examination 

The basic Emergency Medical Technician - Ambulance Practical Examination 
currently in use consists of guidelines " for the physician examiner/coordinator 
and an examination report showing candidates' passing or failing in six topic 
areas. 

The local physician/ examiner is to decide upon the most appropriate situation - 
to present, and to determine the rigorousness of his examination^ within the 
Registry guidelines (See App,endix A) • Thus, great latitud'e was permitted, re- 
sulting in proad differences- in the practical examination from region to region. 

The practical examination developed for use at the University of Southern 
California provided a more rigid framework within which conduct, evaluation, 
scoring of the examination would vary to a lesser degree than the current examina.- 
tion described above. Various elements of performance were listed, and a rater 
(possibly non-medical) would note the time at which the action occurredo The rater 
would also note the, quality of the performance. At a ^subsequent scoring session, 
medical personnel could evaluate the candidate's performance using a colored plastic 
overlay (S'co ring* Template) as a guide (Forms and overlays are in Appendix B) o 
These scoring tepiplates form a standardized guide for the evaluation of candidate 
response times ^ ' ', 

The Registry, now provided with a model of a new ^testing procedure, needed 
first to evaluate whether or not the new procedure provided any benefits over the 
old examination procedures.- Secondly, the printed material provided by the 
University of- Southern Calif ornia . had to be refined, and, based upon practical 
examining experience, provided with scoring templates based upon empirical data. 
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II. Pilot Testing of the Examination 

A trial run-through of both the traditional (existing) examination procedure 
and of the proposed examination procedure was conducted at two sites to assess the 
differences batween the two procedures, and to gather data to guide final revision 
of the material. /j 

The first location was at the Miami-Dade Community /.College, which has an 
extensive emergency and critical care curriculum. Six/ raters were chosen from 
Miami-badefe faculty^ In addition, both faculty memberls and Miami Fire Department 
paramedics served-^as programmed patients. Twelve persons from the Miami Fire 
Department ai*d from Ipcal ambulance services volunteered as candidates. A control 
group of raters, .Dr. Eubanks, Drc Hyatt, and Mr. Ascher, provided additional data 
to assist with statistical analysiSo 

, An Emergency Medical Technician - Ambulance Practical Examination was then 

/' ■■ . . / 

conducted in one day utilizing the procedures typically in use, following the guide- 
lines in Appendix A. Rating sheets, conforming to the elements listed in the three 

standard stations (pp. A-2, A-3 & A-4) were used so that each of the raters, plus 

i> . ■ • 

the programmed patient, could evaluate each one of the candidates. During this 

examination, the patients comments would be reflected in' the single resultant rating 

sheets It was felt that rather than have nine identical patient evaluations one 

detailed evaluation would do since the programmed patient was himself a paramedic or 

faculty member and could provide valuable data. On the second c'ay 'of the pilot study, 

the E>rr - A practical examination was conducted utilizing the new, time-referenced, 

materials and stations (Appendix B) ; however, the same raters, patients and candidates 

were utilized. Each ti^st was conducted by having one candidate observed by all nine 

raters simultaneously. Thus, each test took considerably longer since no stations 

could be run simultaneously. Response forms were completed after each candidate, 

and collected. 
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/ The second location of a trial run-through was Georgetown University Medical 

co- 
School in Washington, Dc C» Here, Dr. George Hyatt provided seven raters, several 

programmed patients, and ten candidates c As in the previous test, an EMT - A practica 

examination was conducted on the first day in the manner typically in use at George^tow 

University o On the second day, the EMT - A practical examination was ' conducted 

utilizing the new-time-referenced material (Appendix B) , again using the same raters, 

patients and candidates. Every effort was made to keep both the Miami and^the 

Washington, Dp C. tests similar in content, scope and presentationo 



Q 1 ' 

ERIC , 



Ill, Limitation of the Data 



During the course of the trial runs, a number of factors seemed to be important 
enough to note as possibly affecting the data. One of the most readily apparent 
problems was the fatigue and frustra*tion caused by the length of the trial examinatiorio 
Only one candidate could be examined at one time, since all raters needed to observe 
the candidate simultaneously c Candidates, volunteering for this examination, were 
kept isolated in another room, and faced rather long waiting periods between examining 
stations. Raters also exhibited fatigue as the examinations ran into the late evenings 

Difficulties with the rating forms contributed to raters* uncertainty. Lack of 
clarity in the videotape presentation, and in a number of instances, lack of applica- 
bility to the testing situation, necessitated revision of the performance evaluation 
forms. This v/as especially apparent where the rating forms did not follow currently 
accepted AHA-BLS scenarios for CPR. These types of problems seemed to be the primary 
cause of missing response data. That data that v;er;i missing were eliminated by the 
computer programs for some of the statistical analyses; however,- that necessitated 
elimination of the .bulk of the data collected from the Washington test site. The 
statistics that will be presented should be considered with the realization that a 
very limited sample was usedc Not all stations in the new, time-referenced, examina- 
tion procedures were tested. Stations D and E, the largest, longest and most in- 
volved in equipment needs, were eliminated as it became apparent that the rater *s 
and candidate's fatigue limit would be severly tried. 

When programmed patients did not provide identical performances, candidates 
showed great variability in responses which were not attributable to this expected 
field performance. The feedback to the candidate from the programmed patient , turns 
out to be exceptionally important. The best programmed patients were the experienced 
EMT's'^and paramedics, who knew how a patient should react. 

r 

1 - 



For each candidate, every rater's response was considered as a separate 
observation, to provide information on inter-rater reliability. These same data 
were also used to assess the adequacy of each performance evaluation form element 
and the appropriateness of the scoving^^template for that element. The total number 
of observations ( not individual candidates ) used was typically a maximum of 98; 
however, it is important to stress that the number of raters and candidates remained 
fixed at their respective low levels c It must not be presumed that the analysis in 
this report represent anything more than a preliminary indication of what the per- 
formance evaluation design could beo Careful assessment of the first large groups 
of EMT applicants should provide the necessary information for the further improvement 
and evaluation* of these rating forms o 



IV. Data Analyses 



The rating forms for the "traditional", presently conducted, examination 
consisted of three stations following in content the elements listed on pp. A-2 
through respectively o For each element, three subjective evaluations, 
excellent, satisfactory, unsatisfactory were possible. They were assigned arbitrary 
numerical values of 3, 2 and 1, and coded onto punch cards, recording the candidate's 
and rater identification on each card. Each rater was also asked to provide a pass/ 
fail evaluation, and this was also coded for each observation as a 2 or a 1, respec- 
tively. In addition to each of the 9 raters' evaluations, the programmed patient, 
a faculty member or paramedic, was asked to provide a ratingo These rater responses 
for the stations - a total of 110 observations and pass/f ail decisions - were analyzed 
using SPSS, the Statistical Package for the Social Sciences, on an IBM, 370 computero 

The rating forms for the new, "time-referenced" practical examination proposed 
by the University of Southern California, originally consisted of six stations, A 
through with the last being divided into three separate sections (Appendix B). 
When the trial examinations were conducted, only Stations A, B, C and^F (Parts 1 & 3) 
were completed, primarily because of very real consideration for time and fatigueo 
Station F, part 2, was eliminated because its performance evaluation is essentially 
identical to part 1. Stations D and E were eliminated because of the lengthy time 
and large amount of eqTiipment involved. Again, each rater was asked to. make a pass/ 
fail evaluation on each of his performance evaluation forms ,^ and the programmed 
patient was asked to make subjective evaluations for each candidate. 

The only change in standard observation procedure occurred on Station F, part 3. 
Original instructions for this station specified that candidates should be evaluated 
as a team. However, each candidate was observed by three of the raters, in that each 
candidate had specific independent actions to perform. The raters felt uncomfortable 



attempting to evaluate this group of complex tasks on a team basis within the 
short time blocks specified. Difficulties were reported by the raters with the 
performance evaluation form as originally presented, in that it was neither easily 
adaptable to adequate rating of a team, nor to the current standards for CPR. 

These performance evaluation fonns had 7 to 10 element time scales and three 
element qualitative scales. To record a rater's response, each time interval was 
assigned a number, from 0 through 10, in ascending sequence, up to the maximum number 
of intervals. The qualitative scale was assigned numbers 3, 2, and 1, like its 
counterpart in the traditional examinationc In addition, the rater *s pass/fail evalu- 
ation was coded as 2 or 1 and a computer record of the scoring template was constructed 
on the same pass/fail basis, 2 and 1, based upon the individual rater ' s responses . 
This template record was -punched into the same data card as other data. Missing data 
.was assigned a special (negative) value by the computer program. Rater's responses 
were punched onto data cards for each station and analyr:ed using the SPSS package. 

The initial task was to determine whether or not the new, "time-referenced" 
evaluation procedure was in fact an improvement over the previous method of test 
administration. For this, inter-rater reliability was. explored using an analysis 
of variance. The rater responses for each of the candidates were compared to find 
how consistently the raters could agree. The responses for each element were also 
correlated with the rater's overall pass/fail determination using a Pearson Corre- 
lation Coefficient. The revised evaluation forms, - those having a time scale as well _ 
as a subjective or qualitative scale, were subjected to additional statistical com- 
parisons. In examining each individual task, a cross tabulation was done to determine 
whether failure to perform the task can predict overall performance on the task. 
This became a possible criterian for exclusion of the task from the station. Pearson 
correlation coefficients were computed between the qualitative and time scale re- 
sponses, to determine what, if anything, was the relation between speed of performance 
and adequacy of such per:f^c?rniance. 



Both time scales and qualitative scales were correlated with the rater's pass/fail 
determination „ Cross-tabulations of the frequences of response for each time interval 
for each station element, and correlation between the rater's pass/fail determination 
and the computer model of the scoring template were done for each station. Adequacy 
of the template may be ascertained by examining the relative percentage of passing 
and failing observations outside the template limits. The need to expand or reduce 
the template may be indicated, by positive or negative correlations with time. The 
qualitative scale was correlated with overall performances to find where unacceptable 
performance is truly predictivec A correlation with time can. indicate the importance 
of a red template area over the qualitative scales. 



Ve Results of AnMlyses 

Of primary importance is this study was the determination of the desirability 
of the use presented, "time-referenced", approach to evaluating a practical 
examination over the traditional examination technique. Primary attention was 
focused on inter-rater reliability, wherein an attempt was made to discern signifi-- 
cant rater effects. in each station. Utilizing an analysis of variance (ANOVA) , the 
significance of the rater effects was explored. (See Appendix C) 
TRADITIONAL EXAMINATION TECHNIQUES 

The initial analysis showed significant rater effects for Stations B and C. of 
the. traditional examination. The sub-element responses of the raters were quite 
variable when compared with their overall pass/fail determination. Station B consisted 
of a variable number of tasks assigned by one of the raters acting as "chief ratero" 
In the actual examination, the tasks are varied to minimize the candidates' communi- 
cation of the problem. Raters found it very difficult to accurately evaluate this 
type of situation o In all the stations, the candidate was asked a number of 
questions following his performance. However, the questions were typically different 
for each candidate, and the raters were left to their own judgment as to the candi- 
date's knowledgeo "* 

As a second step, the responses of the. three individual persons representing 
the Registry, acting as "umpires" for the test, were identified in the data and 
analyzedo In this case, the ANOyA showed relatively high inter-rater reliability 
between these raters. Since it was possible that this consistency, especially in 
Station A, ^-might mask other raters effects, the observations of the six "volunteer" 
raters were analyzed separately, and significant rater effects were then found in 
all stationSo 



NE\^ EXAMINATION TECHNIQUE 

All five of the test stations for the new examination format were subjected to 
the same analysis (ANOVA) (See" Appendix D) • This calculation showed no significant 
rater affects, (ie^ high inter-rater reliability) in Stations A, Fl and F3/ Stations 
B and C showed significant rater effects; however, several other problems occurred 
with Station B including a large variability in the programmed patient's responses, 
and the rater's difficulty in working with the response sheet as originally, presented 
Rater's comments indicated that a revision o£ that performance evaluation form would 
greatly simplify this task. There was also some confusion initially on exactly what 
problems were being presented in Station C, in particular an airway obstruction was 
not a part of the patient's program. Only after the first two victims were all the 
raters aware of the problem, indicating that it is exceptionally important that 
the rater be thoroughly aware beforehand exactly what is to be presented in the 
station. Thus, the inconsistency in Station C can probably be attributed to an 
error in initial briefing of the raters. 

Both quantitative information and subjective evaluations indicated that the 
newer, "time-referenced", examination approach provides a more uniform framework' 
for structuring the evaluation of the candidates. The individual rating sheets, 
however, still were not satisfactory 'according to our raters* Additional statis- 
tical analyses were performed on the task elements of each station to determine 
the desirability of retaining the element and to establish a scoring template that 
would relate to predi^ction of the candidate'^s overall pass/fail evaluation. 

For each element of each station, a frequency distribution and cross-tabula- 
tion, showing how many passes and how many failures were recorded as having 
responded at any one particular time segment, were produced. Pearson Correlations 
between the overalT~Pas5^/Faal evaluations and times of response qualitative judge- 
ments, and a simulation of the template (overlay) were performed, as well as 
additional statistics. 
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In the tables that follow, the most significant statistics are presented. Other 
statistics for these data are presented in Appendices E through I. 
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TABLE 1-1 
STATION A 



TASK 



Percent of 
Failures not 
Performing Task 



Percent of 
Passes not 
Performing Ta^k 



Percent of 
Failures not 
Passing Template 



Percent of 
Passes Passiilf 
Template 



1. Checks and Clears 
Airways 



42.7% 



23.8% 



39.6% 



65,8% 



2. Manually seals 
chest wound 



13.3% 



IA.3% 



73.3% 



52.7% 



3. Effective action to 
ap^ply dressing to 
chest wound 

A J Removes knife 



25.3% 



19.0% 



A1.A% 



No Candidate "Removed Knife 



23.8% 



5. Secures knife in 

place 

6. Administers 0^ 



7. Manages Patient's 
Restlessness 



70o7% 
80.0% 
72.0% 



38.1% 



61 0 9% 



A2.9% 



0% 



13.2% 



A. 8% 



33.3% 



8. Survey exam 



48.0% 



33.0% 



9o Other Action 



* No template originally specified. 
** Too few observations. 



TABLE 1-2 
STATION A 
Pearson Correlation Coefficients 



TASK 



Checks and Clears 
Airways 



Pearson 
Correlation 
Time vs 
Pass/Fail 

.0975 



Pearson 
Correlation 
Qualitative 
vs Pass/Fail 

28AA** 



Pearson 

Correlation 

Template 

vs Pass/Fail 

.2002* 



Pearson 
Correlation 
Qualitative 
vs Time ' 

.2062 



2. Manually seals 
Chest Wound 



-.0559 



.0291 



-.1904* 



.1309 



3. Effective action 

to apply dressing 
/ to chest wound 

y' 

4o Removes knife 



-olOAl 



.0266 



-.1935* 



•NO CANDIDATE REMOVED KNIFE o 



.1179 



5. Secures knife 
in place 



.3711** 



.4304*** 



,2108** 



-.1534 



6. Administers O2 



.2856 



.2229 



.4257*** 



.5730*** 



7a Manages Patient's 
Restlessness 



.4263*** 



**** 



,5549*** 



8» Survey Exam 



.0079 



,1895 



**** 



-.1994 



9 u Other Action -.0412 .6770*** **** **** 




* Significant at 0.10 Level 
** Significant at .05 Level 
*** Significant at .01 Level 
**** Computer could not coinpute coefficient; 

no Teniplate specified, or'no cases occurred. 



NOTE: Detailed listing in Appendix E. 
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Station A provided consistent rater responses, and exhibited a reasonable 
number of well-defined tasks. Tasks 1, 5 and 7 were especially good predictors 
of overall performance, and were significantly correlated with their respective 
qualitative ?cales, Data for Jask 2 showed that the lack of qualitative corre;Lation 
is most probably a result of the EMl^^s releasing the' manual seal to put on a 
drLSsingc If the template was changed to 1 minute, ^ seconds, 85% of the passing 
observations would pass the template, prc^ably increasing this task's predi::tive 
valueo Task 3 also presented problems, because th^candidates found it nearly 
impossible to effect a good seal over a rubber moulageo Further, the programmed 
patient may not show any positive signs as a result of the bandaging, again, 
accounting for the lack of correlation of the qualitative scaleo Changing the 
template to 1 minute, 30^, seconds could allow 76.1% of the passing observations to 
pass the template. The template for Task 5 was set at a point where very few 
of the candidates can achieve completion. The candidates typically concerned 
themselves with the chest wound; however,- if the mask was moved to 1:45, 47.6% of 
passing observations would pass the template, whereas only 8„7% of failing observa- 
tions would pass the template. This, perhaps is the better place for the template 
limit. The qualitative scale (ie. time scale) for this task is significantly 
correlated with overall performance. Task 6 had its template set at 1:45, however, 
no passing observations occurred in the previous time slot, and the mask could be 
moved to 1:30 without altering the existing data. The qualitative scale was not 
correlated- with overall performance probably because the administration of O2 
created a favorable impression upon the raters, irrespective of other performance. 
Althvjugh no template was specified for Task 7, the qualitative scale was signifi- • 
cantly correlated with overall performance. Tasks 3 and 9 were not correlated with 
overall performance, and the remarks of the raters suggest the elimination of 
these two* tasks. 



TABLE 2 - 1 
STATION D c'^ 



TASK 



Percent of Percent of Percent of* 

Failures not Pass'es not Failures Pass- 

Performing Task Performing- Task ing Template 



1. Check and Clear 
Airway 



5.7% 



32% 



Percent of* 
Passes Pass- 
ing Template 



62% 



Proposed' 
Template 
Location 



2o' Adequate Inquiry 



3. Checks; Scalp 



38% 



74% 



8.6% 
65.7% 



56% 



icic 



80% 



4. Eyes 



50% 



"37.1% 



5. Ears 



86% 



77.1% 



6, Cervical Spines 



76% 



86.6% 



7o Chest 



74% 



51.4% 



8o ' Abdomen 



9. Back 



72% 



72% 



62.9% 
74.0% 



10. -Legs 



8.0% 



11.4% 



11, Arms 



28% 



17.1% 



12. Discovers Seizure ' 58% 



13o Identifies Dilantin 88% 



22^9% 
62.9% 



42.0% 



\ '77.1% 



14. Manual Assessment 34% 

of Elbow 

15. Reassures Patient 34% 



11.4% 



22.9% 



32% 



77.2% 



16o Splints Elbow * 42% 25.7% 58% 74.2% 

*No teoplate was originally specifie4 for this station. Selection of template- 
loc'afe^lon based upon pass rate^ . 
Q ( x*The series of checks, having a high proportion of missing observations is either 
ERXC to be compressed into one or two tasks; ^r^^no template is to be selected. 



TABLE 2-2 
STATION B 
"Pearson Correlation Coefficients 



/ 



TASK. Pearson Correlation 

f' Time vs Pass/Fail 

1. Check and Clear .1656 
Airways 

' 2. Adequate Inquiry -.2489*^ 

3.. Checks: Scalp .1448 

4. Eyes -.0356 

5. Ears -.1546 ■• 

6. Cervical Spines -.3291 
7c Chest -.1494 

8, Abdomen ^ -.2302 

9. Back • - -,2336 

10. Legs -.2965*** 

11. Arms -„1062 

12. Discovers Seizures -.1741 

13. Identifies Dilantin -.4311* 

14. Manual Assessment .3700*** 

of Elbow 

15. Reassures Patient -.1417 
16j Splints Elbow .1210 



Pearson Correlation 
Qualitative vs 
Pass/Fail 

.4709*** 



.3299** 

.0892 

.3180** 

.1349 ' 

.2653 

.3365** 

.2306 

.2797 

.2743** 

ol444 

.3881*** 

.3245 

:2806* 

.3028** 
.3746*** 



Pearson Correlatio 
Qualitative vs 
Time 

,0626 



.3538** 

.2397 

.0029 
, .0697 

„1297 
-.1029 
-.3937* 

ol633 
-.0402 

o0900, 
-.0636 
-.0632 

.2601* 

-.0595 
-.0403 



* Significant at OolO Level 

** Significant at .05 Level 

*** Significant at .01 Level 

**** Computer could not compute coefficient. 



NOTE: Detailed listing in Appendix F„ 
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Station B received some criticism from the raters, primarily due to the length 
of the rating form. Careful programming of the patient is necessary to insure con- 
sistency in situation presentation. The data generated provided guidance in selecting 
template limits for this station, as none was provided originally. Tasks 1, 2, 12, 
14 and 16 were good predictors of overall performance. Tasks 3-11 were either not 
adequately observed or bear little relation individually to overall performance. 
These can be grouped under the general heading- of "Patient Survey." Although Task 10 
has a significant correlation of its qualitative scale with overall performance, the ■ 
data indicates that deletion would be advisable." Its time scale is negatively 
correlated with overall performance, indicating that the .leg exam is typically per- 
formed later in the problem. However, a thorough leg examination wastes the candi- 
dates time and he does not get to complete the problem. While a good leg examination 
makes a favorable impression on the raters, performance falls off, as shown by 
the increasing number of failing observations failing to perform subsequent tasks: 

TABLE 2-3 

Task 11 .• 28o0% 
Task 12 58.0% 
Task 13 88o0% 

For this reason, candidates that make an early leg examination subsequently may 
receive a failing rating on overall performance. Task 13 has a negative Pearson 
correlation, and is generally performed later. Tasks 14, 15 and 16 all have signi- 
ficant qualitative scale correlations, and should be included. 
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TABLE 3-1 



STATION C 



TASK 



Percent of 
Failures not 



1, Checks Airway 73.1% 



Percent of 
Passes not 



Percent of 
Failures -not 



60.6% 



19.2% 



Percent of 
Passes Passi 



Performing Task Performing -Task- Pas-s in g -Template ILemplat 



36,4% 



2o Survey Exam 



30.8% 



12.1% 



67.2% 



87.9% 



3. Adequate History 



17,3% 



12.1% 



82,7% 



88.0% 



4. Special Exam 

Head, chest, 
abdomen 

5. Special Exam 

Ankle, foo't 



61.5% 



42o3% 



4 2. ,4% 



33 o 3% 



•36.5% 



60.6% 



51,5% 



60.6% 



6. Selects Leg Splint 57=7% 



7o Prepares Splint 



8. Applies Splint 



34.6% 



51 o 9% 



24.2% 



18.2% 



27.3% 



42o5% 



65.4% 



48.1% 



75,8% 
81.8% 
72.7% 



9. Elevate Leg 



90,4% 



10. Reassures Patient .50.0% 



97oO% 
27.3% 



9.6% 



3,0% 



11. Rechecks Patient 



82.7% 



84.8% 



* No template originally specified. 
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TASK 



lo Checks Airway 
2. Survey Exam 



TABLE" 3-2 
STATION C 
Pearson Correlation Coefficients 



Pearson 
Correlation 
Time vs 
Pass/Fail 

.2646 



1258 



Pearson 
Correlation 
Qualitative 
vs Pass/Fail 

o2159 



o2741^^ 



Pearson 

Correlation 

Template 

vs Pass/Fail 



**** 



,232A** 



Pearson 
Correlation 
Qualitative 
vs Time 

-.2609 



,1912 



3. Adequate History -.0785 



4. Special Exam 

Head, Chest, 
Abdomen 

5. Special Exam 

Ankle, Foot 



-.3440** 



-.2669* 



6„ Selects Leg Splint -k0747 



.2913** 
.6027*** 

o2552* 
.0420 



.0195 



,1809* 



.0595 



,3586*** 



,1012 



-.1739 



,0216 



.0841 



7. Prepares Splint -.1078 



,2845** 



.1963* 



,1886 



8. Applies Splint -.2576* 



.3996*** 



.2251** 



2395 



9. Elevate Leg 



.3627 



.4166** 



-.1162 



**** 



10. Reassures Patient -.2211 



.2066 



**** 



.0417 



11. Rechecks Patient -.6291** 



-o0857 



**** 



* Significant at 0.10 Level 
** Significant at .05 Level 
*** Significant at .01 Level 
**** Computer could not compute coefficient or 
too few cases occurredo 



**** 



NOTE: Detailed listing in Appendix Gc 
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In Station C, Tasks 2, 7, 8 and 10 seemed to be good predictors of overall 
performance. The poor showing of Task 1, seemingly most imporfant, was simply 
a reflection of a good airway at the- start of the problem. In Task 2, moving the 
template from 2:00 to 0:45 enhances the predictive ability by permitting 87.9% . 
of the passing observation to pass the mask. More failing observations than 
passes fall into the green template area of Task 3, and the green should be deleted. 
Task 4 shows a negative correlation, and is typically completed later. -As the 
existing template is also not well correlated with overall performance, the 
template green area should be eliminated, However, the qualitative scales of both 
iSks are correlated with overall performance, and these tasks should be retained. 

Tasks 5, 6 and 7 have templates correlated with, overall performance, but 
only on Task 7 is the qualitative scale also correlated with performance. Task 9 
is not correlated with performance, and on examination of the data shows that 
only failing observations typically perform in this area, thus it should be deleted, 

- Similarly, Task 11 is not correlated with 'performance, as the raters might 
be confused as to what constitutes a recheckc 
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TABLE 4-1 



STATION F - PART 1 



TASK 



1. Position Head 



Percent of 
Failures not 
Performing Task 



35.3% 



Percent of 
Passes not 
Performing Task 



276%' 



2. Check Breathing 



3o Check pulse 



4. Check pupils 



29.4% 
67.6% 
97.1% 



10o5% 



13.2% 



92al% 



5o Extraneous Acts 



6, Begin ventilation 



7, Effectively inflate 
chest 



32 a 4% 

35,3% 



2.6% 



0% 



8, Cardiac Compression 
at 80/min. 



20.6% 



5.3% 



9o Adequate Compression 



20.0^ 



2,6% 



10. Proper Head Position 



14.7% 



0% 



11. Alternate with 
ventilation at 
proper rate 



26.5% 



0% 



12. Recheck pulse and 
pupils 



79.4% 



52.6% 



NOTE: Template limits for tasks 1-4 and 6 will be the AHA standard 
^ ^ All other tasks on original template cover entire time span 

gP^(];" thus, last two columns c^n^be derived from first two. 



TABLE 4-2 



STATION F - PART 1 
Pearson Correlation Coefficients 



TASK 



1. Position Head 



Pearson 
Correlation 
Time vs 

T-a's-syTattT— 



-o0639 



Pearson 

Correlation 

Qualitative 

-^Ts-^^a^fFai-l- 



,.5452*** 



Pearson 

Correlation 

Template 

-^ s Pas s Z -^i-l- 



.2891** 



Pearson 

Correlation 

Qualitative 

vs TiTTie 



,b550 



2, Check Breathing 



.1235 



.3570*** 



.2891** 



.3425*** 



'3. Check pulse 
4. Check pupils 



-.2078 



.6366 



.2908 



o5580*** 



.1599 



«1376 



-o2599 



5. Extratieous Acts 



**** 



-.OA 13 



**** 



**** 



6. Begin ventilation .0585 



7- Effectively inflate o2524* 
chest 



.4653*** 
6552*** 



.3085*** V 



.4962*** 



,1072 



.1983 



8. Cardiac Compression .0727 
at 80/min. 



,5019*** 



,2637** 



.0374 



9. Adequate Compression -.0176 



10. Proper Head 
Position 



-.0513 



,A911*** 
.4297*** 



.3155*** 



,3188*** 



.1999* 



.22A3* 



11. Alternate with 
ventilation at 
proper rate 



-.073A 



.5352*** 



,A2A6*** 



,1A92 



12. Recheck pupils and 
pulse 



-.021A 



,3682** 



. 3393*** 



-.0109 



ERIC 



* Significant at 0.10 Level 
** Significant at .05 Level 
*** Significant at .01 Level 

Computer could not compute coef f icient ;' ' no Template specified, 
or no cases occurred^ 

NOTE: Detailed listing in Appendix Ho q 



In Station F, Part 1, it is T?.ost noticable that time is generally not well 

E 

correlated with overall performance, while the template and qualitative scales are. 
"Rater" comments~"conf Trmed that the time interval of 10 seconds, with rapid activity r. 
change, was ^too short to adequately record. The template, in broadening the time 
limits, helped identify this problem. The time limit has been changed to 15 seconds 
and the Task layout structured to closely resemble the AllA. - BLS scenario, a 
deficiency of the existing evaluation form (See Appendix B^j* 

All tasks, except Task 4 and 5 were ^predictive of overall performance. The 
checking of pupils should be dropped in that it is typically not performed and not 
-correlated with overall performance. The notation of extraneous acts properly 
belongs as a comment, so as not to interfere with the rater's notations. For Task 5 

the data analyses indicate that the template limit is appropriately placed at 

30 seconds. 
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TABLE 5-1 



STATION F - PART 3 



TASK 



lo Position Head 



Percent of • 
Failures not - 
Performing Task 

40:0% 



Percent of 
Passes not < 
Performing Task 

11.8% 



2. Check Breathing 



60 = 0% 



■ 47.1% 



■3. Check pulse 



4. Check pupils 



5. Extraneous Acts 



60.0% 



100% 



100% 



35,3% 
94.1% 
88.2% 



6.' Begin Ventilation 



70.0% 



58.8% 



7. Effectively Inflate 
chest 



35.0% 



17.6% 



8. Cardiac Compression 



15o0% 



11.8% 



9- Adequate Compression 



10. Proper Head 
Position 



35,0% 



30.0% 



5„9% 



11.8% 



9 



Ho Proper Ratio 
12. Recheck pulse 
13o Maintain Ventilation 



40.0% 
19.1% , 
65.0% 



5.9% 
13.5% 

17o6% 



14. Switch 



70.0% 



35o3% 



NOTE: Template limits for tasks 1-4 and 6 will be the AHA Standards. 

All other tasks on the original template cover the entire time space, 
thus, the last two columns can be derived from the first two. 
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TABLE 5-2 
STATION F - PART 3 



Pearson Correlation Coefficients 



TASK 



1. Position Head 



Pearson 
Correlation 
Time vs 
Pass/Fail 

.1075 



Pearson 
Correlation 
Qualitative 
vs Pass/Fail 

,5882*** 



Pearson 

Correlation 

Template 

vs Pass/Fail 

.2362 



Pearson 
Correlation 
Qualitative 
vs Time 

.0086 



2 3 Check Breathing 



.0617 



.6325** 



.1336 



-.0547 



3. Check Pulse 



.0548 



.4023* 



,4135* 



-o3805 



4, Check Pupils 



3651 



,1985 



**** 



5o Extraneous Acts 



**** 



-.3721 



**** 



**** 



6." Begin Ventilation 



7. Effectively 

Inflate Chest 



,1A09 



-=0230 



,3568 
.6262*** 



.19C9 



,1803 



.1997 



.3377* 



8. Cardiac Compression 



,0160 



,A685*** 



,0359 



.1260 



9. Adequate Compression 



lOi Proper Head 
Poisition 



,2316 



,0262 



.5592*** 



,0739 



,3436** 



,2582 



.0787 
.1093 



11. Proper ratio 



12 o Recheck Pulse 



,20Z5 



,2928 



.6298*** 

,0555 



,3873** ' 



,1256 



,2201 



.2372 



13. Maintain Ventilation -.0178 



.5006*** 



. .5292*** 



,2407 



14. Switch 



.0660 



,4830** 



o3857** 



-,2147 



ERIC 



* Significant at 0.10 Level ^ 
** Significant at .05 Level 
*** Significant at .01 Level 
**** Computer could not compute coef f ici-ent ; no Template specified, 
or no cases occurred. 



NOTE: Detailed listing in 



Appendix I . G u 



Data for Station F - Part 3, showed no significant rater effects, however, 
a Pearson Correlation was not significant, indicating that possibly the raters 
had trouble deciding- on the candidate's overall performance. The evaluation forni 
does not follow closely enough to the AHA-BLS standards, and the layout of the 
f orra. is not conducive to ease of rater response, A revision of dhe sheet is 
necessary to accomodate the tasks needed, however, all raters raised strong objection 
to attempting to rate the team. The most acceptable solution here, considering ^ 
the range of tasks, is to have each candidate rated individually'c In this station 
also, raters complained of the close timing, making it Virtually impossible to rate 
, accuratelyc In this station, as in Part 1, Tasks 1 through 3, 6 through 11, 13 

and 14 are predictive of overall performance, although again, time is not correlated 
with per forma n'ee. Tasks 4 and 5 show the same lack of import as in Part 1. The 
recheck of pulse and pupils, Task 12, is not correlated with performance. Over 
90i^ of all observations were missing here. 
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VI o Conclusions 

The primary objective of this study was to determine the advantage, if any, 
of a structured, "time-referenced", performance examination procedure (Appendix B) , 
over the existing procedure (Appendix A).. The data indicate that the use of this 
more structured approach, even in the face of less than ideal task selection, can 
•^provide a more reliable guide for the evaluation of performance examinations. 

Analysis of the six standard stations yields" information that can guide the 
establishment of predictive criteria for the scoring templates. The structure of 

9 

the performance evaluation forms and the scoring templates provides a source for 
a large amount of empirical dkta with which- the researcher can objectively eval- 
uate the adequacy of both the station tasks selected and' the scoring standards used. 

In Appendix J are the performance evaluation forms revised on the basis of 
the information contained in the previous section. The forms for Station F, Part 2, 
and its associated 'scoring template are virtually identical to Scacion F, Part Ic 
More difficult to revise were the team stations D and E. Raters complained that 
where individual tasks could be performed separately, as ^in Traction Splinting or 
••CPR, it. becomes difficult if not impossible to adequately rate both individuals. 
■ Thus, traction splinting has been modified to include a demonstration of leadership, 
and manual skills by both candidates. Station D, involving use of a backboard, _ 
sufficiently involves both EMT's that both can demonstrate manual skill, as well as 
show the very necessary ability to perform as a team member. Design of the scoring 
tetuplates for these two stations was guided by data from Stations B and C. In 
Station D, survey and evaluation will probably not be well-correlated with overall 

if 

performance, but the manual skills directly involved in patient welfare will be. 
The scoring template is extended to account for f.Iic performance o£ most manipulative 
skills later in the problem. Similarly, in Station E, the manual skills can be ex- 
pected to be well-correlated with performance, but rechecks are typically not so 
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predictive. The nature of this activity is such that one EMT typically performs 
most of the work, thus, each E-IT must apply a splint, being evaluated primarily 
on his skill at controlling the situation. 

The CPR stations presented the most vexing general problem, that of a con- 
tinuing task. Since it is important for the iJhysician/evaluator to know when a 
candidate is not maintaining various BLS activities, the task was cast in a 
negative frame, and the scoring template highlighted in a distinctive color. Thus, 
once the candidate has started, the rater has the somewhat easier task of noting 
lapses in technique. It is hoped that this will simplify the rater's job, yielding 
more accurate and consistent data.. Station F, Part 3 was rewritten to permit the 
ra'ter to continuously follow the EMT's activities, by "looping" back up' through 
■.repeated tasks-. Since each EMT is rated individually, the. rdter (two required for 
..this paift) can concentrate on the qualrfy of the CPR throughout the 3 minutes. The 
maximiiia time of this station was reduced, based upon our field observations. It is 
quite clear within "the first 45 seconds whether each team member is proficient at 

CPR. • 

Rater comments were'^also noted for the qualitative scales. As shown in 
- Appendix J, the new performance evaluation forms have a simplified qualitative 

scale: acceptable or unacceptable. There was little benefit seen in having a third 
category, which can encourage the selection of the center (non-committed) response. 
Here, raters must decide whether the activity meets minimum criteria for acccpta- 
bility^ « 

Although the field research for this project was completed using a smaller 

than desirable sample, the data collected makes- a good' case for the use of this new 

approach. It will not only help standardize the various examinations now being 

given, but will facilitate the evaluation of new practickl problems and task groups. 

Of great importance is the continued monitoring and analysis of this test in the 

. *■ 

field, utilizing much larger samples to confirm the preliminary indications of this 
evaluation study- „^ 
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APPENDIX A 



EXISTING PRACTICAL EXAMINATION PROCEDURES 
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■ ■ I^ATIOIL^L REGISTRY 0? ZMERGSNCY I-SDTCAl TECHNICIANS 
.. ■ SUXES-TED PR0C 5 DURSS ?0R THE PRACTICAL E^AI-liFATION " 

THE E-^'SICIAN Ii: C'-J^RGE 0? THE PPACTICAT EX^JllMTIOK I-'AY ENLIST THE HELP OF 
OTHER PiriSICIANS vrHO- .^^-RE Ki:OVn:£DGEABLS IK EI-IERGEKCY CARE TOOCEDURES II; PRO- . , 
•VIDIKG :THE,EXAl'ttNATIO:i, THE I.-JI-IBER OF PHYSICIANS I^-EEDED WILL BE IN DIRECT 
R.'^TIQ^'tHE 'KUI/iBBR Or'" EX/u-lIISE3 FOR EACH EXAMINING SESSION. 

IT IS SUGGESTED THAT THE PHYSICIAN EX;ii^ii::ER/COORDINATOR SEEK THE COOPERATION 
OF THE LOCAL HEART ASSOCIATION, RED CROSS, OR SIMILAR AGENCY TO PROVIDE FOR 
ThE USE OF RESUSCIANTES, SPLINTS, BAG-MASK-RESUSCITATORS , ANT) BOTH SHORT 
AND LONG BACKBOARDS WITH STRAPS. AT THE DISCRETION OF THE PHYSICIAN EXAJ/iINER/ 
COORDIFiATOR, THES'; ;:.F;r,,,N'I7ATI0NS 'MY PROVIDE NON-PITYSICIAN HIGHLY TRAIN^ED , 
PERSOM-iEL TO HELP WITH E:tAMI NATIONS . THE APPLICANT^ WILL BE IN STRUCTED TO 
BRING WITH HIM ALL EXPSI'IDABLS ITEMS SUCH AS CRAVATS, BA NDAGES, AND DRESSINGS . 

THIS OUTLIN-E IS PROVIDED IffiRELY AS A GUIDE TO MAINTAIN SOME UNIFORMITY 
Ti-iROUGHOUT THE NATION IN THE ADMIIrESTRATIOi: OF THIS PRACTICAL EXAMIJiiiTION. 
THE FHYSICIAN EXAiMINER MAY SUPPLEI^SNT OR D:-LSTE ITEMS AT HIS DISCRETION. 

[T IS SUGGESTED THAT THE EX/.MINATION SITE 33 DIVIDED INTO THREE STATIONS, EACH 
WITH APFROPRIATE EQUIPMEJIT AS SHOW ON THE ATTACHED PAGES ;° DEPENDING UPON THE 
NUI-IBER OF APPLICANTS, A SERIES OF GROUPS OF THREE STATIONS MAY E^B I^IECESSAKY ;. 

THE APPLICANTS MAY PRaiRESS rtlROUGH THE STATIONS IN PAIRS. THE EYAlhlFSR 
SHOULD EVALUATE THE SKILLS OF EACH APPLICAIT IN APPLICATIO^^i OF THTi Ey^RGENCY ' 
CARE PROCEDURES, QUESTION HIS I-ETiWD, QUESTION ABOUT OTHER REIATED TASKS, J^ND 
EVALUATE HIS. PROFESSIONAL ATTITiiDE TCV.7'RD Till VICTIM AND OrriERS. . ^ 

GRADING TS TO BE 'w-JP^LY ON 'A PASS OR FAIL 5ASIG 'FOR EACH OF THB"i,-SIX SECTIONS 
OF THE PRACTICAL E-.TAMINATiOri. FAILING 0^;^ OR TWO SECTIONS PERIHTS THE 
EmiINEE TO BE RE-E:<AMINT,D IN THE SECTIONS FAILED. HONTsVER, FAILING TrlREE 
OR MORE SECTIONS, CONSTITUTES TOTAL FAIL'JRS OF Th"E EXAMIK/vTION. 



' . ' STATION # -1 

CARDIO-FJLMONARY-RSSUSCITATION 

rffiCESSARY EQUIR^WT ' ^ . 

Resusciarmes and cleaning swabs \ ^ , 

Bag-masli. . * ' ^ 

Airways 

Blankets 

THE PROCEDURES TO -BE EVALUAT2D ARE ; 

1. POSITION OF THE VICTIMS HEAD AITO NECK TO ESTABLISH AN OPEN AIRPASSAGE 

2 . THE PROPER USE OF AIRWAYS - SIZE AND INSERTION 

3% APPLICATION OF MOUTH TO MOUTH AND THE USE OF THE BAG-MASK 
k. RECOGNITION OF SIGNS INDICATING THE NEED FOR C.P.R. 
5. LOCATES PROPER AREA TO APPLY PRESSURE ON THE STERNUM ' 
6- 'MAIKT^AINS A RATE OF 60 TO 8o COMPRESSIONS PER MINUTE 

7. HAVE SECOND EMT MONITOR CABOTID PULSE TO CHECK THE EFFECTIVENESS 
OF PROCEDURE 

8. HAVE APPLICANTS CHAN3E POSITION AS VENTILATOR AND C0MERE3S0R 

9. QUESTION APPLICANTS ON RELATED PROBLENiS, (FACE INJURIES, CHEST 
INJURIES, TRANSPORTATION, ETC.) 



A- 2 



STATION # 2 
IMMOBILIZATION OF FRACTUBES 



NECESSARY EQUIPMENT 



Half-Ring splints 

Board splints - assorted lengths 

Inflatable splints 

Half- spine board and Long- spine board with straps 
Blankets 



THE PROCEDURES TO BE EVALUATED ARE; 



1. RECOGNIZES THE SIGNS AMD SYMPTOMS OF FRACTURES AND DISLOCATIONS 

2 . MAIIWAINS Airo OPEN AIRWAY AND TRK^TS FOR SHOCK 

3. IMMOBILIZES AiL FRACTURES BEFORE MOVING VICTIM (EXCEPT FOR 

IMPENDING DANGERS) 
h . CONTROLS BLEEDING AND DRESSES WOUNDS OF ALL OPEN FRACTURES 

5. IMMOBILIZES BEYOND THE ADJACENT JOINTS 

6. APPLIES AND MAINTAINS TRACTION UNTIL SPLINT IS FIXED IN PLACE 

7. SPLINTS SECURELY APPLIED, BUT DOES NOT INTERFERE WITH CIRCULATION > 

8. DEMONSTRATES THE PROPER APPLICATION OF ONE OR MORE OF THE FOLLOWING: 
THE HALF-RI^G SPLINT, BOARD SPLINTS, INFLATABLE SPLINTS, HALF-BOARD, 
LONG-BOAPJ), Ar© BLArjKET ROLL SPLINT 

9. QUESTION APPLICANT ON RELATED PROBLExMS, (EXTRICATION, TRANSPORTATION 
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STATION #3 
BLEEDIKG COMTROL - SHOCK - WQUM) CABE 

NECESSAHY EQUIRffilTr 

Applicants will "be instructed to "bring bandages, dressings, and 
cravats . 

THE PROCEDURES TO BE EVALUATED ARE : 

1. RECOGNITION OF WOUND TYPES, 

OPEN - ABRASIONS, LACERATIONS, AND PUNCTURES 
CLOSED - BRUISES AND CONTUSIONS 

2. . DEMONSTRATES METHODS OF BLEEDING CONTROL, DIRECT PRESSURE, PRESSURE 

DRESSING, PRESSURE POINTS, AND LIMITED USE OF THE TOURNIQUET AND 
ITS DANGERS. 

3. HANDLING OF DRESSINGS TO MAINTAIN STERILITY 

h. SECURES DRESSING VTITH PROPER BANDAGE (NO ELASTIC BANDAGES) 

5. USE OF NON- POROUS MATERIAL FOR SEALING A SUCKING CHEST WOUND 

I . 6. IMMOBILIZATION OF SEVERELY INJURED PARTS 

7. DOES NOT REMOVE PROTRUDING OBJECTS 

8. AVULSED PART TO ACCOMPANY VICTIM TO THE HOSPITAL 
9- RECOGNIZES THE SIGNS AND SYMPTOMS OF SHOCK ' 

10. ATTEMJ^S TO PREVErTT SHOCK BY TREATING THE CAfeE ~ * 



GEKSRAL KKDWIEDGE 

' THE EXAMINING PHYSICIAN, AT HIS DISCRETIONy MAY QUESTION THE APPLICANT AS 
TO THE. GENERAL KISDWLEDGE OF AMEULA.NCE OPERATIONS . SUCH QUESTIONS MAY 
INCLUDE: • . 

• 

1. DRIVING OF THE AMBULANCE, TO THE SCENE, AND FROM THE SCENE TO 
HOSPITAL 

2. SAFETY AT THE EMERGEJS^Y SITE TO PREVENT FURTHER ACCIDENTS f ""X^ 

3. M0VEMSI7P OF THE VICTIM FROiM THE ACCIDENT AREA TO THE AMBULANCE 
h. COMMUNICATIONS AND THE USE OF RADIO TO BASE AND/OR HOSPITAL 

5. WRITTEN AND VERBAL REPORTING 



rf 



THE 



SOCIAL SECURITY NOl. 



NATIONAL REGISTRY 
of 

EMERGENCY MEDIGALTECHNICIANS 

E.M.T. AMBULANCE - EXAMINATION REPORT 



■registry No.. 



□ □. □ 

PASS RETEST FAIL 



Name of Applicant 



MIDDLE INITIAL-. 



Address, 



STATE 



2IF 



Place of Written Exam: 



.Date. 



Signature.of pjiy^iciah monitoring written exam: 
Remarks: 



Place of Practical Exam: 



Section on Cardiopulmonary Resuscitation 
Splinting 
Bandaging ^ 
Wound Care 
Shock 

General Knowledge 

Remarks: - 



Passed. 
Passed. 
Passed - 
Passed. 
Passed. 
Passed, 



Date 

Failed. 
Failed. 
Failed. 
Failed. 
Failed. 
Failed. 



Signature of physician monitoring practical exam: 



Retest Location. 
Section:_L__ 



ERIC 



Signature of physician monitoring retest: 



Passed. 
Passed. 



Date 

Failed. 
Failed. 



APPENDIX B 
"Time Referenced" Examination Procedure 



ERIC 



The audiovisual presentation and the User's Guide were developed as a result of 
the National Registrj'^'s awareness of the need for a standardized practical examination 
to coincide with the Registry's written examination. It was obvious that a practical 
exam be both standardized, and relatively easy to administer to a large number of 
candidates. 

It is anticipated that this examination format will make a significant contribution 
to the goal of the National Registry in establishing a nationally standardized practical 
examination procedure which will be objective, valid and consistent. 

The ^'User's Guide'' will enhance and support the audiovisual presentation and will 
describe in detail the technique of organizing and conducting a practical performance 
examination for the EMT-Ambulance. However, the User's Guide alone should provide 
complete direction and instructions xji the administj'ation of subsequent practical exami- 

/ 

nations, without the audi" visual presentation. The objective scoring procedure that has 
been developed is based on specific performance criteria; thereby allowing the exam 
procedure to be reproducible^^fcienever and wherever the test is administered. As 
such, this examination fori.iat is flexible and adaptable to change to meet local needs 
and situations and still main' ain its uniformity. 

We ask thf:t you adc - all questions, problems, changes and modifications of 
this examination to clie Nadonal Registry so that we may evaluate, and share all 
meaningful adaptations with the entire nation. Your reports should be sent to the 
Executive Direcior, National Registry of Emergency Medical Technicians, 
P. O. Box '29233, Columbus, Ohio 43229. 
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THS 



:45 



1:00 



EFFECTIVELY 
INFLATES CHEST 



CARDIA COMPRES- 
SION + 80 MIN. 



ADEQUATE 
COMPRESSION 



PROPER HAND 
POSITION 



PROPER RATIO & 
TIMING BETWEEN 
VENTILATION & 
COMPRESSION 



RECHECK PULSE 
& PUPILS 



MAINTAIN VENTIL- 
ATION & COMPRESS 



TEAM MEMBERS 
SWITCH, IMAINTAIN 
RATIO, TIMING & 
TECHNIQUE 



ERIC 



1:30 



2:00 



3:00 



4:00 



Check . . 
Technique 



7^ o 



o 
a 
X 

w 



o 

•< 



U 

o 

O I 



B-16 

€3 



STATION F - PART IH 
CPR - ADULT (TEAM) 



CANDIDATE TEAM: 



2. 



(GRADE AS A TEAM ONLY, USING SINGLE SCORING FORM) 
EXAM DATE: 



& TIME: 



EXAMINER:' 



VICTIM: 



COMMENTS: 



PROBLEMS, ETC.: 



EXAMINERS: DO NOT WRITE BELOW THIS LINE 



SCORING 

OUTCOME 



j '^ASS 



□ 



FAIL 



Conflx^matlon: 



Date 



Signature 



Signature 



PRACTICAL EXAM 

STATION F - Part m 
CPR ^ ADUT T 
(TEAM) 



Technique 



TASK 



POSITION HKAD TO 
ESTABLISH AIRWAY 



CHECK BREATHING 



CHECK PULSE 
(CAROTID) 



CHECK PUPILS 



(EXTRANEOUS 
ACTS) 



BEGINS VjJNTIL- 

imON UNTIL 3-4 
GOhn KRF.ATHS 



EFFECTIVELY 
INFLATES CHEST 



CARDL«i COMPRES- 
SION + 80 MiN. 



ADEQUATE • 
COMPRESSION 



<3> 



PROPJ-IR HAND 
POSITION 



PROPER RATjlO & 
TIMING BETWEEN 
VENTILATION & 
COMPRESSION 



RECHECK PULSE 
& PUPILS 



MAINTAIN VENTIL- 
ATION & COMPRESS 



TEAM MEMBERS 
SWITCH, MAINTAIN 
RATIO, TIMING & , 
TECHNIQUE 




ERIC 



SCORING OVKRLAYy COLOR AREAS 



APPENDIX C 



Analysis of Variance 



"Traditional Style" of Examination 



All raters taken together: 



Station A 
F = 1.220 
P *= 0.300 



Station B 
F = 3.748 
P = .001 



Six volunteer raters (Exclusion of primary researchers) 



Station C 
F = 4.986 
P = .001 



Station A 
F = 1.987 
"P =" -.097 V 



Station B 
F = 4o859 
P =- "TOOl 



Station C 
F = 2.462 

-P = -.048- 



Primary researchers alone (Exam "umpires") 



Station A 
F = .279 
P = o999 



Station B 
F = 2„243 
P = .131 



Station C 



P = o999 



* Observations showed no variance. 



ERIC 
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APP-ENDIX D ^ 

Analysis of Variance 
Performance Evaluation Approach 



EKLC 



Appendix D 
Analysis of Variance 
Performance Evaluation^i^ptjfqacH' 



Station A F = .829 

P = .999 



("Station B F = 2.485 
P = ^c049 



Station C F = 4o633 

P = .003 



Station F-1 F = 1.795 

P = cl39 



Station F-3 F = 0,945 

P = .999 
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A P P E" N, D I X- E 



Station A 

\ 

Peareon Correlation Coefficients. 



Station A 



Pearson Correlation Coefficients 



TASK 



Time 



Qualitative 



Template 



Qualitative 









vs 






vs 


vs 






VS 


; 




Pass/Fail 


Pass/Fail 


Pass/Fail 






Time 


1. Checks & Clears 




C 


= .0975 


C 




.2844 


C = .2002 


c 


_ 


.2062 


Airway 




N 


= ( 59) 


N 




( 68) . 


N = ( 85) 


N 


= 


( .51) 






P 


= .463 


P 




.019 


P = .066 


P 




.147 


2. Manually Seals 




C 


= -.0559 


C 




.0291 


. C =-1904 


-c 




.1309 


Chest Wound 




N 


= ( 83) 


N 




( 68) 


N = ( 86) 


N 




( 68) 






P 


.616 


P 




.814 


P = .079 


P 




.287 


3; Effective action to 




C 


= -.1041 


C 




.0266 


C =~.1935 


C 




.1179 


apply dressing to 




N 


= ( 73) 


N 




( 67) 


N = ( 86) 


N 




( 65) 


^ chest wound 




P 


= o381 


P 




.831 


P = o074 


P 




.350 


4. Removes knife 






**** 




**** 


5. Secures knife 




c 


= .3711 


C 




.4304 


C = .2108 


C 




-.1534 


in place 




N 


= ( 35) 


N 




( 47) 


N = ( 86) 


N 




( 27) 






P 


•= .028 


B 




o003 


P = ,051 


P 




.445 


V/. Administers Oo 




C 


= .2856 


C 




.2229 


C = .4257 


C 




.5730 






N 


T ( 23) 


N 




( 45) 


= ( 86) 


N 




( 20) 


\ ■ ■ 




P 


= ol86 


P 




.141 


P ■= oOOl 


P 




.008 


\ 

^. Manages Patient's 




C 


= -;1834 


C 




.4ft3 




C 




.5549 


\ Restlessness 




N 


= ( 33) 


N 




( 54) 




N 




( 25) 






P 


= .307 


P 




vOOl 




P 






8o Survey exam 




C 


= .0079 


C 




. 1895 


**** 


C 




-.1994 






N 


= ( 53) 


N 




( 53) 




N 




( 36) 






P 


= o955 


P 




ol74 




P 




.244 


9. Other Action 




C 


= -.0412 


C 




.6770 


**** 


**** 






N 


= ( 9) 


N 




( 13) 














P 


= 916. 


P 




.011 











**** Computers could not compute coefficient. 



Q E - 1 
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APPENDIX F 



Station B 
Pearson Correlation' Coefficients 



ERIC 



Appendix F 



Station B 
Pearson Correlation Coefficients 



TASK 



Time 
vs 

Pass/Fail 



Qualitative 
vs 

Pass/Fail 



Qualitative 

vs / 
Time 



1, 


Check and Clear 


C 




.1656 


C 


= 


.4709 




Airway 


N 




( 61) 


N 




( 52) 






P 


= 


.202 


P 


= 


.001 


2. 


Adequate Inquiry 


C 


= 


.2489 


C 




.3299 






N 




( 63) 


N 




( 56) 






P 


= 


.049 


P 




.013 


3. 


Checks: Scalp 


C 


= 


.1448 


C 


= 


.0892 






N 




( 25) 


N 




( 32) 






P 


= 


.490 


P 


= 


.627 


4. 


Eyes 


n 


= 


-.0356 


C 


= 


.3180 






N 




( 47) 


N 




( 46) 






P 




.812 


P 


= 


.031 


5. 


Ears 


C 




-.1546 


C 


= 


.1349 






N 




( 15) 


N 




( 26) 






P 


= 


.582 


P 




.511 


6. 


Cervical Spines 


C 


= 


-.3291 


C 




.2653 






N 




( 23) 


N 




( 38) 






P 




.125 


P 


= 


.107 


7. 


Chest 


C 




-.1494 


C 


= 


.3365 






N 




( 30) 


N 




( 36) 






P 


= 


.431 


P 


= 


.045 


8. 


Abdomen 


C 




- 2302 


C 




.2306 






N 




( 27) 


N 




( 35) 






P 




.248 


P 




.183 


9- 


Back 


C 




-.2336 


C 




* 

.2797 






N 




( 23) 


N 




( 31) 






P 




.283 


P 




.128 


10. 


Legs 


C 




- 2965 


C 




.2743 






N 




( 77) 


N 




( 64) 






P 




.009 


p 




.028 



C = .0626 
N = ( 50) 
P = .666 



C = .3538 

N = ( 51) 
P = .01,1 



C 
N 
P 



C 
N 
P 



.2397 

( / 19) 
.323 



.,b029 

(' 39) 
J986 



C = ,.0679 
N =i( 11) 
P ='.839 



C = .1297 
N = ( 22) 
P p .565 



Cl = -.1029 
N= ( 25) 
P = .625 



C 
P 



C 
N 
P 



C 
N 



-.3937 
( 20) 
.086 



.1633 
( 12) 
.612 



-.0402 
( 64) 
.753 



ERIC 
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Appendix F 
Station B 
Pearson Correlation Coefficients 



TASK, conto Time Qualitative Qualitative 

vs vs vs 

Pass /Fail Pass/ Fail Time 



1 1 

J.X • 




r — 


m XUD ^ 






C = 


• 0900 






N = 


( 65) 


N = 


( 54) 


N = 


( 53) 






T> — 
r — 


Ann 


P = 




P = 


• 522 


1 9 




p — 


— 1 7A1 
• X / ^X 




• DOO± 


C =~ 


• 0636 






N = 


( 48) 


N = 


( 48) 


N = 


( 40) 






"D — 

r — 


9 '5 7 


p = 


• UUD 


P = 


696 


1 7 

± J o 


XQenuxxxes uxxanuxn 




»^ jXX 


p — 




r = 


.0632 






N = 


( 19) 


■N = 


( 26) 


N = 


( 14) 






T> - — 

r — 


o VJD J 


p = 

IT 


• XUD 


P = 


.830 


14. 


Manual Assessment 


c = 


.3700 


c = 


.2806 


C = 


.2601 




of Elbow 


N = 


( 64) 


N = 


( 49) 


N = 


( 48) 






P = 


.003 


P = 


.051 


P = 


.074 


15. 


Reassures Patient 


C = 


,1417 


C = 


.3208 


C = 


-.0595 






N = 


( 60) 


N = 


( 46) 


N = 


( 45) 






P = 


.280 


P = 


,041 


P = 


.698 


16. 


Splints Elbow 


C = 


.1210 


C = 


.3746 


C = 


-.0403 






N = 


( 55) 


N = 


( 48) 


N = 


( 4?) 






P = 


.379 


P = 


,009 


P = 


,800 



so 

ErJc f - 2 



APPENDIX G 



Station C 
Pearson Correlation Coefficients 



TASK 



Appendix G 
Station C 
Pearson Corr^-lation Coefficients 



Time 



Qualitative 



Template 



Qualitative 









vs 






vs 




VS 






vs 






Pass/Fail 


Pass/Fail 


Pass/Fail 






T"l TTIP 


1. 


Checks Airway 


L 


= .2d4o 


C 




.2159 


C 




C 


= 


-.2609 






XT 
IN 




XT 




C 33) 


XT 

N 




N.. 




( 24) 






p 


= .182 . 


p 


— 


o228 


P 


= **** 


p 








Survey Exam 


L 




C 




. 2741 


C 


= .2324 


C 


= 


.1912 










XT 




( 48) 


XT 

N 


- ( 85) 




— 


( 48) 






P 


= ,318 


p 




o059 


P 


= .032 


p 






3. 


Adequate History 


/-t 
L 


r\ *7 o c 

- •(J7o5 


C 




. 2913 


C 


= .0195 


c 


= 


.1012 






XT 


- ( 72) 


XT 

N 




( 57) 


N 


= ( 85) 


N 




( 55) 






p 


= o512 


p 


— 


.028 


P 


= .860 


p 




• H O ^ 


4. 


Special exam; Head, 


c 


= .3440 


C 




.6027 


C 


= .1809 


C 




-.1739 




chest, abdomen 


XT 

N 


= ( 39) 


N 




( 41) 


N 


= ( 84) 


N 


= 


( 30) 






P 


= o032 


P 


— 


oOOl 


P 


= .100 


p. 

XT 






5. 


Special exam; 


c 


= ".2669 


C 




.2552 


.,c 


= .0595 


c 


= 


.0216 




ankle, foot 


N. 


= ( 52) 


N 




( 54) 


• ^ XT 

N 


= ( 84) 


N 




( 41) 






P 


= ,056 ' 


P 




.063 


p 


= .591 


p 

XT 






6. 


Selects leg splint 


C 




C 




.0420 


c 


= .3586 


C 


= 


.0841 






N 


- ( 47) 


N 




(' 43) 


N 


= ( 85) 


N 


= 


( 37) 






P 


= .618 


P 


— 


o789 


P 


= .001 


p 






7„ 


Prepares splint 


C 


= ~ 1073 


C 




.2845 


C 


= .1963 


C 


= 


.1886 






N 


f /'t\ 

- ( 61 ) 


N 




( 50) 


N 


= ( 85) 


N 


= 


( 44) 






P 




P 




, 045 


P 


= .072 


p 

I. 




9 90 


8. 


Applies splint 


C 


= -.2576 


C 




.3996 


C 


= .2251 


c 




.2395 






N 


= ( 49) 


N 




( 48) 


N 


= ( 85) 


N 




( 37) 




/ 


p 


= .074 


P 




.005 


P 


= .038 


P 




.153 


Q 


K 1 P XtrK t" P 1 P O 


C 


= .3627 


C 




-.4166 


C 


= -.1162 


C 










N 


= ( 6) 


N 




( 26) 


. N 


= ( 82) 


.N 










P 


= .480 


P 




.034 


1. 


= .299 


P 






lOo 


Reassures patient 


C 


= -.2211 


C 




.2066 


**** 


C 




.0417 






N 


= ( 50) 


N 




( 40) 






N 




( 33) 






P 


= .123 


P 




.201 






P 




.818 


11. 


Rechecks patient 


C 


= -.6291 


C 




-.0857 




**** 






N 


= ( 14) 


N 




( 27) 
















P 


= .016 


P 




.671 













**** Coefficient could not be computed or too few cases observed. 
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A P P' E N L I X H 



Station F - Part. 1 
Pearson Correlation Coefficients 



-i 
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/ 



TASK 



\ Tr'Positdbn Heaa 



2. Check Breathing 



3. Check F Ise 



4o Check Pupils 



5. Extravenous Acts 



6. Begin Ventilation 



7. Effectively inflate 
chest 



8i, Cardiac Compression 
at -SO/miUo 



9. Adequate Compression 



10. Proper Head Position 



11, Alternates^ with 

•Ventilation at 
Proper rate 

• /• > 

12. Recheck pulse and 
/ pupils . 



Appendix H ' , 
Station F-Part 1 
Pearson Correlation Coefficients 



Time 
. vs 
Piss/Fail 

-C ;0639- 



N 
P 

C 
N 
P 

C 
N 
P 

C 
N 
P 



( 59) 
.631 

.1235 
( 58) 
o356 

-2078 
C 44) 
.176 

o6366 
( . 4) 
.363 



C = .0585 

N = ( 60) 
P = .657 

C = .2524 
N = ( 60) 
P = .052 

C = .0727 

N =• ( -63) 
P =■ c,571 

C = -.0176 
N = ( 64) 
P = .890 

C = -.0513 
N = ( 67) 
P = .680 

C = .0734 
N = ( 63) 
P = .568 

C = .0214 

N = ( 25) 
P = o919 



Qualitative 
vs 

Pass/Fail 



Template 
vs 

Pass/Fail 



Qualitative 

VJ 

Time 



e 




-.-545-2 


- - G- 


= 


^-2891- - 


— C- 


=._. 


-^.055& 


N 




( 55) 


N 




( 72) 


N 




( 57) 


P 





.001 


P 




-o0i4 


P 




.684 


C 


= 


.3570 


C 




.2891 


c- 




.3425 


N 




( 57) 


N 




( 72) 


N 




( 57) 


P 




o006 


P 




o014 


P 




.009 


C 


= 


o4779 


C 




.5580 


C 




.1376 


N 




( 54) 


-N 




( 72) 


N 




( 45) 


P 




.001 


P 




.001 


P 




.367 


C 


= 


.2908 


C 




.1599 


C 




-.2599 


N 




( 27) 


N 




( 72) 






( 6) 


P 




ol41 


P 




:i8o 


P 




.619 


C 


= 


-0413 


**** 






N 


: 


( 16) 














P 




o879 














c' 


= 


.4653 


C 




.3085 


C 




.1072\^ 


N 




( 60) 


N 




( 72) 


N 




( 64) 


P 





oOOl 


P 




.008 


P 




.399 


C 




.6552 


C 




.4962 


C 




.1983 


N 




( 59) 


N 




( 72) 


N 




( 65) 


p 




.001 


P 




,001 


P 




.113" 


C 


= 


.5019 


C 




.2637 


C 




.0374 


N 


: 


( 63) 


N 




( 72) . 


N 




( 72) 


P 




oOOl 


P 




.025 


P 




.755 


c 


— 


.4911 


C 




.3155 


C 




.1999 


N 




'( 67) 






( 72) 


N 




( 74) 


P 




.001 


F 




.007 


P 




.080 


C 




.4297 


C, 




.3188> 


C 




.2243 


N 




(" 62) 


N 


IS 


( 72) 


N 




( 72) 


P 




oOOl 


P 




o006 


P 




.058 


c. 




'=5352 


: c 




.4246 ' 


C 




.1492 


N 




( 59) 


N 




( 72) 


' N 




( 64) 


P 




.001 


P 




.001 


P 




.239 


C 




.3682 


C 




.3393 


C 




-0109 


N 




( 43) 


N 




C v72> 


N 




( 25) 


P 




.015 


P 


es 


.004 


• P 




.959 
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Station I - Part 3 
Pearson Correlation Coefficient 



EKLC 



Station F - Part 3 
Pearson Correlation Coefficients 



TASK 



1« Positior; Head 



2. Check Breathing 



3. Check Pulse 



4o Check Pupils 



5. Extraneous Acts 



6« Begin' Ventilx;tion 



7. Effectively inflate 
cjiest 



8. Cardiac Compression, 



9* Adequate Compression 



10. r^oper Head pdsi'jion 



llo Proper ratio. 



12^ Recheck pulse 



puli 



13. Maintain Veltilation 



Time 
vs 

Pass/Fail 



Qualitative 
vs 

Pass/Fail 



Template 
vs 

Pass /Fail 



Qualitative 
vs 
Time . 



EKLC 



c = 


ol075 


c 




.5882 


C 




o2362 


C 




.0086 ^ 


N =. 


( 27) 


N 




( 24) 


N 




( 30) 


N 




( 25) 


P = 


.594 


p 






p 






P 




967 


C = 


.0617 


r 
\j 




• \J U *m ^ 


' C 




.1336 


C 




-.0547 


N = 


( 17) 


N 




( 15) 


N 




( 30) 


N 




( 16) 


P = 


,814 


P 




.011 


P 




o481 


P 




,840 


C = 


.0548 


c 




402"? 


C 




.4135 


C 




-'3205 


N = 


( 19) 


N 





( 21) 


N 




( 30) 


N 




(.. 16) 


P n 


„824 


P 




.071 


P 




.023 


P 




.146 . 




r 
\j 




o ^ U X 


C 




o985 










N 






N 




( 30) 












P 


= 


.220 


P 




.293 








**** 


( ' 






**** 








N 




( 1) 






















.'13 














c = 


.1409 








C 




1909 


c 




.1997 


N = 


( 13) 


N 






N 


= 


( 30) 


N 


= 


( 14) 


P = 


.646 








P 




.312 


P 




.494 


C = 


.0230 


r 






C 




.1803 


C 




.3377 


N = 


( 27) 


N 






' N 




( 36) 


N 




( 30) 


P = 


.909 


P 




.001 


P 




.293 


P 




.068 


C = 


.0160 


r 
\j 




o H U O 


C 




0359 


C 




.1260 


N = 


( 32) 


■ N 






N 




( 36) 


N 




( 32) 


P' = 


.931 


P 




o009 


P 




o835 


P 




.492 


C = 


.2316 


r 






C 




.3436 ' 


C 




.0787 


N = 


( 29) 


N 





( 2S) 


N 




( 36) 


N 




( 32) 


P = 


„227 


P 




.002 


P 




.040 


P 




.668 


C = 


- 0262 


c 




n7-'^9 


C 




.2582' 


C 




.1093 


N = 


( 29) 


N 




( 28) 


N 




( 36) 


N 




( 33) 


P =-. 


,893 


P 




.709 


P 




= 128 


P 




.545 


C = 


.2075 


C 




.6298 


C 




.3873 


C 




.2201 


N = 


( 28) 


N 




( 30) 


N 




( 36) 


N 




( 32) 


P = 


.289 


P 




.001 


P 




,020 


P 




.226. 


C = 


.2928 


C 




.0555 


C 




.1256 


C 




= 2372 


N = 


C 8) 


N 




( 18) 






( 36) 


N 




( 9) 


P =- 


,482 


P 




.827 


P 




.466 


P 




o539 


C = 


-0178 


C 




.5006 


C 




.5292 


C 




.2407' 


N ■ = 


( 21) 


N 




( 27) 


' N 




( 36) 


N 




( ^23) 


T) - 








nno 















APPENDIX J 



Revised Practical Examination Performance Evaluation Forms 



. ' • . 87 

ERIC 



NATIONAL REGISTRY OF Ef-IEgGENCY MEDICAL TECHNICIANS 

PERFORMANCE EVALUATION FORM 
• ■ BASIC EMT-A 








. 1 
i 


NOTE 




STATIOf>l A 




TlCHNtQirE 


TIME \ 


'■'.ACCEPTABLE 
i ... 


, WOT 
ACCEPTABLE 




: 15 


:30 




1:00 


1:15 


1 2 :-• ■ ^ : 45 


2 s 00 


2:15' 


2 : <: 


airv;ay checked 

AMD C\ FARFH 




• 








j 








i! 




ChEST WOUND 

^ MANltlAI 1 Y ^FAI FH 














> 






■ 




EFFECTIVE ACTION 
TO APPLY DRESSING 
1 U v*ric,o 1 wuuiNU 














i 
I 










KNIFE REMOVED 


























KNIF^ SECURED 
I»N PLACE 


























OXYGEN ADMINISTERED 


























PATIEN-T'S RESTLES- 
NESS MANAGED 






















t 

1 




ADEQUATE PATIENT 
SURVEY PERFORrZD 








i . 










i 
1 






PATIENT'S EVALUATIOr 


\ OF THE CANDIDATE 




i 



COMMENTS: 



i 



NOTE EXTRANEOUS ACTIONS: 




PO 



NATIONAL REGISTRY OF EKiERGENCY l^iED I CAL TECHNICIANS 

-- • - •. N 

PERFORMANCE EVAliUATlON FORM ' 
BASIC EMT - A 



.JS.taJ:j-Qn_A Chest and Abdominal V/ounds 



Candidates Name: 



Exam Date [ Time 

Examiners Signature: . 



EXAMINERS: DO NOT WRITE BELOW THIS TiNE 



Final Scoring □ Pass 

□ Fail 



Conf i rmation 



Date Signature :y ' ' Signatura 



J . ■ ■ ■ 



S3 



erJc 



fJATIONAL REGISTRY OF .EMERGENCY MEDICAL TECHNICIANS 
EXAMINATION SCORING TEMPLATE - 




BO 



MATIONAt REGISTRY OF EMERGENCY fOfCAL TEGHNICIANS 

PERFORMANCE EVALUATIO;! FORM 
. BASIC EMT-A 



STATIOri B 


TIME 


•NOTE 

TCPUM 1 

. 1 LLnrU 

a. 
uz 

Cj 


ni !c . 

O 04 

Cj 
Cj 

^ • 




: 30 


1:00 


1 : 30 


2 : 00 


2: 3 0 


3 : 00 


3:30 


4:00 


AIRWAY CHECKEft AND CLEARED 






















ADEQUATE INQ;UIRY INTO 
IMMEDIATE PR^OBLEM 






















Thorough patient 
survey performed 








-, t, 






< 








ELBOW FRACTURE 
ADEQUATELY- ASSESSED 






















ELBOW FRACTURE 
ADEQUATELY SPLINTED 






















SEIZURE -i.o A FACTOR 
DISCOVERED BY HISTORY 






















DILANTIN IDENTIFIED 


















i 




PATIENT REASSURED 






















PATIENT'S EVALUATION OF THE CAl^DIDATE 







COfWENTS: i-:.- 



) 



MOTE EXTRANEOUS ACTIONS: 



NATIONAL. REGISTRY OF Ef^HRGENCY MEDICAL TECHNICIANS 

PERFORMANCE EVALUATION FORM 
BASIC EMT - A 



Station 3 



Epi lepsy . 



Candidates Name: 
Exam Date: 



Ti me 



Examiners Signature: 



EXAMINERS^ DO NOT WRIlTE BELOW THIS LINE 



Final Scoring Q Pass 

□ Fail 



Conf i rmat ion 



Date Signature Signature 



EKLC 



NATIONAL REGISTRY OF EMERGENCY MEDICAL TECHNICIANS 
EXAMINATION SCORING TEMPLATE ^ 

I 

ST ATION B 





ERIC 



9- 

J 4 



NATIONAL REr3lSTRY OF EriERGENCY MEDICAL TECHNICIANS 



PERFORMANCf: EVALUATION FORM 
BASIC EMT-A 



STATION C 



!T£C!i::iQUE- 



: 15 



: 30 



: 45 



1 :00 



1:15 



1 : 30 



1 : 45 



2 :00 



2:15 



2 : 30 




AIRWAY CHECKED 



ADEQUATE PATIENT 
SURVEY PERFORMED 



ADEQUATE HISTORY 
OBTAINED 



SPECIAL EXAM OF 
HEAD AND TRUNK 
SPECIAL EXAM OF 
ANKLE AND FOOT, 
NERVES Z CTRCULATICN 



SHORT LEG SPLINT 
SELECTED 



SPLINT PREPARED 
SPLINT APPLIED 
PATIENT REASSURED 

: I I \ L_ 

PATIENT'S FVALUATION OF THE CANDIDATE 

COmEilTS : 



I, 



i^nTE EXTRANEOUS ACTIO.NS: 

ERIC 



NATIONAL REGISTRY OF EHLKMLY ntUlLML ! tLMiiiLiHiNo 

PERFORMANCE EVALUATION FORM 
BASIC EMT - A 

Station C 

* 

Candidates Name: 
Exam Date: 

Exanu ners S ignature: 

i. 



EXAM I NERS : DO NOT WRITE BLEOW THIS LINE 



Final Scoring □ Pass 

□ Fail 

Confirmation 



Closer! Fracture 



Time 



Date 



Signature Signature 



ERIC 



NATIONAL REGISTRY .OF EMERGENCY MEDICAL TECHNICIANS , 

PERFORMANCE EVALUATION FORM 
BASIC EMT-A 



STATION D 

tha:-: evaluation 

\ 








frJ 1 E 
TECUM I( 

g- 

a, ■ 

o 
s: 


:]UE 

»^ 

O B, - 


\ ■ 


: 30 


1:00 


1 : 30 


2:00 


2 : 30 


3 J 00 


3 : 30 


4 : 00 


4 : 30 


5 ; 0 0 


ADEQUATE PnMTIENT 
SURVEY PERFbj^MED 


























\^ 

SITUATION ADEQUXTELY 
EVALUATED 


























POSSIBLE SKULL 
FRACTURE R.ECOGNI ZED 


























POSSIBLE SPINAL 
FRACTURE RECOGNI ZED 


























SPINE HELD IN 
ALIG^^SMENT 






















i! 




PATIENT SECURED TO 
BACKBPARO 






















1 




DOES NOT MAINTAIN 

SPINE ALIGNMENT 



























HEAD SECURED USING 
COLLAR, SANDBAGS 










i 
















• ORGANIZED TEAM 
APPROACH 


























PATIENT'S EVALUATION. OF CANDIDATES AS A TEAM 


ll 





COMMENTS: 



NOTE EXTRANEOUS ACTIONS: 



ERIC 



J - 7 



NATrOML REGISTRY OF EilERGENCY flEDiCAL IcCHNiUAi^b 

PERFORMANCE EVALUATION FORM . 
BASIC EMT - A 



Station D 



Head and Spine Injury 



Candidates Name: , l) 

2) 



(Grade as a team, using only, one evaluation form) 



Exam Date: 



Time 



Examiners Signature: 



EXAM I NERS : DO NOT WRITE BELOW THIS" LINE 



Final Scoring 



□ Psss 

□ Fail 



Conf i rmat ion 



Date 



S ignature 



Signature 



NATIONAL REGISTRY OF EMERGENCY MEDICAL TECHNICIANS 
EXAMINATION SCORING TEMPLATE 



NATIONAL -REGISTRY OF EiCRGENCY MEDICAL TECHNICIANS 

PERFORMANCE EVALUATIOfi FORM 
BASIC EMT-A 



STATION E 

t:OTE SPLINT SELi-CTiON: 
HAP.E; TiiOlAS 



\\ KOTE 

l! TECH:;iquE 



LENGTH ADJUSTED (H) OR 
WINDLASS PREPARED (T) 

CROSS STRAPS OR 
SLINGS PREPARED 



TIME 



;30 



ANKLE HITCH PREPARED 



DOES NOT assure 

CONTINUOUS MAINTENANCE 
OF TRACTION 



1 : 00 



1 : 30 



SPLINT FITTED TO THE 
PELVIC AREA 



INGUINAL STRAPS SECURED 



GENITALIA ENTRAPPED 



TRACTION APPLIED WITH 
THE SPLINT 



LEG ADEQUATELY SECURED 
IN SPLINT 



PELVIC CONTACT RECHECKED 



CIRCULATORY SUFFICIENCY 
RECHECKED 



2 : 00 



2 : 30 



3 : 00 



3 : 30 



4:00 



PATIENT'S EVALUATION OF THE CANDIDATE' 



t3 



►J 

o 

-=5 



COMMENTS: 



100 



NOTE EXTRANEOUS ACTIONS 



ERIC 



T _ Q 



NATIONAL REGISTRY OF EfCRGENCY f€DICAL TECHNICIANS 

- PERFORMANCE EVALUATION FORiM 

'fim^r EMT - A 



Station E 



Candidates Name: 



Jon Spl inting 



'(Each candidate' IS graded individually, even though another assists.) 



Partner's Name: 
Exam Date: 



Time 



Examiners Signature: 



EXAMINERS: DO NOT WRITE BELOW THIS LINE 



Final Scoring 



□ Pass 

□ Fail 



Conf I rmat ion 



Date 



Signature 



Signature 




NATIONAL REGISTRY OF EMERHENCY MEDICAL TECHNICIANS 
EXAMINATION SCORING TEMPLATE 



STATION.! 





ERIC 



J. - 10 



NATIONAL REGISTRY OF Ef';ERGENCY. MEDICAL TECHNICIANS 

, PERFORMANCE EVALUATION FORM 
BASIC Ef'lT-A 



- 

STATION F - PART 1 

Ci^R - ADULT 

AW:::-: - vvwituessed 


TIME 




i;0T 

TECHii 

g 


E 

lOUE 

Si. 

o p. 
o 




: 15 


:50 


: 45 


1 : 00 


1 :.15 


1 : 30 


1 :45 


2 : 00 


LEVEL OF CONSCIOUSNESS 
ESTABLISHED 






















ESTABLISH AIRWAY 






















BREATHING CHECKED 


















« 


- 


FOUR QUICK VENTILATIONS 






















PULSE CHECKED 






















CARDIAC CuMHRc. bo 1 UN 
STARTED 






















P U t o tN U I r 1 M JL IN I M 1 IN 

\ CORRECT HAND POSITION 






















nnp<^ wnT matmtatn 

UUCO iNU 1 rlr\ i IN 1 r\ 1 IN 
^ - CORRECT RATE (80/MIN) 























DUcS InU r MAIN IAIN 

CORRECT FORCE (1-^1/2 - 2) 






















DOES NOT MAINTAIN 

CORRECT PATIO ( 15:2) 






















DOFS NOT PROVIDE 

EFFECTIVE VENTILATION 




0 


















PULSE PECHECKED 























COIviEriTS: 



flOTE EXTRANEOUS ACTIONS: 



NATIONAL REGISTRY. OF EMERGENCY MEDICAL TECHNICIANS 

PERFORMANCE EVALUATION FORM 
BASIC EMT - A 



Station F - Part I CPR - Adult, alone, unwitnessed. 

Candidates Name: ' : 

Exam Date: J : 

Examiners Signature: , 



EXAMINERS: DO NOT WRITE BELOW THIS LINE 



Xina-1-Scoring Q Pass 

□ •Fai'1 



Conf ! rmation 



Date > Signature Signature 

\ 



NATIONAL REGISTR 
^ EXAMINA 



r ftTlDN ,F - PART 1 



NATIONAL REGISTRY OF EriERGENCY MEDICAL TECHNICIANS 

' PERFORMAMCE EVALUATION FORM 
BASIC EMT-A 



i 

CTTTTO*! C D"DT 9 

c??. - infa::t 
al6::e - U!:wit::essed 


i 
1 

i 

1 

TIME 


NOTE 
TECH.-ii 

r « 

k". 

tCt 

O 


quE' 

5 




: 15 


: 30 


: 45 


1 : 00 


1:15 


1 : 30 


1 : 45 


2 :00 


LEVEL OF CONSCIOUSNESS 
.. ESTABLISHED 






















INFANT POSITIONED TO 
EST A L I SH ' A IR V/ A Y - 






• 
















BREATH I NG CHECKED 
















c 






FOUR QUICK VENTILATIONS 












I 










PULSE CHECKED 
















i 

1 






CARD I AC COMPRESSION 
STARTED 
















1 

J 


1 


■ 


DOES NOT MAINTAIN 

CORRECT rlN^GER POSITION 


















1. 




DDES NOT MAINTAIN 

CORRECT COMPRESSION RATE 






















DOES NOT MAINTAIN 

CORRECT FORCE (1/2-3/4 IN.) 






















DOES NOT MAINTAIN 

CUKKtLI K/-\liU \ O • I / 






















DOES NOT PROVIDE. 

EFFECTIVE VENTILATION 




















i , 


PULSE RHCHECKED 























COMMENTS:.., 



NOTE EXTRANEOUS ACTIONS: 



NATIONAL REGISTRY OF. EMERGEflCY MEDICAL TECHNICIANS 

PERFORMANCE EVALUATION FORM 
BASIC EMT - A 



Station F - Part 2 



CPR - Infant, alone, unwitnessed 



Candidates Name: 
Exam Date: 



Time 



Examiners Signature 



EXAMINERS: DO NOT WRITE BELOW THIS LINE 



Final Scoring □ Pass 

□ Fail 



Conf i rmat I on 



Date 



Signature 



Signature . 



ERIC 



NATIONAL REGISTRY OF EMERGENCY r^EDICAL 
EXAMINATION SCORING TEMPLATE 



;tatio n f 



N-JATIONAL REGISTRY OF EMERGENCY MEDICAL TECHNICIANS 

PEf^FORf-:AMCE EVALUATION FORM 
BASIC EMT-A' . 



STATION F - PARTJ. 

' CPR - ADULT 
. . » TEm - U^r.-.Tl'NKSSED 

•ANDIDATE STARTED ''.-.'ITH [CHECK] : 

ve:itiiJxTION; co:::pre^sion 



NOTE 

TECHMIQUE 




COMPRESSION TASKS 

DG^S NOT MAINTAIN 

CORRECT HAND POSITION 


























/ 




OOES.NQI MAIlvfTAIN 

CORRECT RATE (60/MIN) 
















7 














pQES NOT MAINTAIN ^ 

CORRECT FORCE (1-1/2 - 2& 






























CORRECT TECHNIQUE 
USED FOR SVJITCH 






























SWITCH SITUATION 
ADEQUATELY CONTROLLED 




























\ 







COMMENTS: 



•3 ■ 



NOTE EXTRANEOUS ACTIONS: 



ERIC 



J - 15 . 



NATIONAL. REGISTRY OF EMERGENCY .'sEDICAL TECHNICIANS 

PERFORMANCE EVALUAT I ON ,FORM 
BASIC EMT - A 



Station F r Part 3 



CPR " Adult, team, unwitnessed 



Candidates Name-: 
Partner's Name: 



-7^ 



(Each candidate is graded individually, even though another assists.) 



Exam Date: 



Time 



Exam? ners S ignature: 



EXAMINERS: DO NOT WRITE BELOW THIS LINE 



Final Scoring 



□ Pass 

□ Fail 



Conf i rmation 



Date 



S ignature 



S ignature 



lio 



ERIC 



/ 




ERIC 



J - 16 



